Concavity of reweighted Kikuchi approximation
نویسندگان
چکیده
We analyze a reweighted version of the Kikuchi approximation for estimating the log partition function of a product distribution defined over a region graph. We establish sufficient conditions for the concavity of our reweighted objective function in terms of weight assignments in the Kikuchi expansion, and show that a reweighted version of the sum product algorithm applied to the Kikuchi region graph will produce global optima of the Kikuchi approximation whenever the algorithm converges. When the region graph has two layers, corresponding to a Bethe approximation, we show that our sufficient conditions for concavity are also necessary. Finally, we provide an explicit characterization of the polytope of concavity in terms of the cycle structure of the region graph. We conclude with simulations that demonstrate the advantages of the reweighted Kikuchi approach.
منابع مشابه
Variational and Dynamical Perspectives On Learning and Optimization
Variational and Dynamical Perspectives On Learning and Optimization by Andre Yohannes Wibisono Doctor of Philosophy in Computer Science University of California, Berkeley Professor Michael Jordan, Chair The problem of learning from data is prevalent in the modern scientific age, and optimization provides a natural mathematical language for describing learning problems. We study some problems in...
متن کاملFast General Norm Approximation via Iteratively Reweighted Least Squares
This paper describes an efficient method for general norm approximation that appears frequently in various computer vision problems. Such a lot of problems are differently formulated, but frequently require to minimize the sum of weighted norms as the general norm approximation. Therefore we extend Iteratively Reweighted Least Squares (IRLS) that is originally for minimizing single norm. The pr...
متن کاملEvaluation of the concavity depth and inclination in jaws using CBCT
Introduction: Nowadays, using implants as a choice in patient's treatment plans has become popular. The aim of this study was to determine the prevalence of mandibular lingual and maxillary buccal concavity, mean concavity depth and angle and its relation to age and gender. Materials and Methods: In 200 CBCT, concavity depth and angle were measured in 2 mm superior to the inferior alveolar c...
متن کاملEstimation and Marginalization Using the Kikuchi Approximation Methods
In this letter, we examine a general method of approximation, known as the Kikuchi approximation method, for finding the marginals of a product distribution, as well as the corresponding partition function. The Kikuchi approximation method defines a certain constrained optimization problem, called the Kikuchi problem, and treats its stationary points as approximations to the desired marginals. ...
متن کامل